decentralised machine learning
Experimenting with Emerging RISC-V Systems for Decentralised Machine Learning
Mittone, Gianluca, Tonci, Nicolò, Birke, Robert, Colonnelli, Iacopo, Medić, Doriana, Bartolini, Andrea, Esposito, Roberto, Parisi, Emanuele, Beneventi, Francesco, Polato, Mirko, Torquati, Massimo, Benini, Luca, Aldinucci, Marco
Decentralised Machine Learning (DML) enables collaborative machine learning without centralised input data. Federated Learning (FL) and Edge Inference are examples of DML. While tools for DML (especially FL) are starting to flourish, many are not flexible and portable enough to experiment with novel processors (e.g., RISC-V), non-fully connected network topologies, and asynchronous collaboration schemes. We overcome these limitations via a domain-specific language allowing us to map DML schemes to an underlying middleware, i.e. the FastFlow parallel programming library. We experiment with it by generating different working DML schemes on x86-64 and ARM platforms and an emerging RISC-V one. We characterise the performance and energy efficiency of the presented schemes and systems. As a byproduct, we introduce a RISC-V porting of the PyTorch framework, the first publicly available to our knowledge.
FedGrad: Optimisation in Decentralised Machine Learning
Federated Learning is a machine learning paradigm where we aim to train machine learning models in a distributed fashion. Many clients/edge devices collaborate with each other to train a single model on the central. Clients do not share their own datasets with each other, decoupling computation and data on the same device. In this paper, we propose yet another adaptive federated optimization method and some other ideas in the field of federated learning. We also perform experiments using these methods and showcase the improvement in the overall performance of federated learning.